Self-exploration of the Stumpy Robot with Predictive Information Maximization
نویسندگان
چکیده
One of the long-term goals of artificial life research is to create autonomous, self-motivated, and intelligent animats. We study an intrinsic motivation system for behavioral self-exploration based on the maximization of the predictive information using the Stumpy robot, which is the first evaluation of the algorithm on a real robot. The control is organized in a closed-loop fashion with a reactive controller that is subject to fast synaptic dynamics. Even though the available sensors of the robot produce very noisy and peaky signals, the self-exploration algorithm was successful and various emerging behaviors were observed.
منابع مشابه
Gaze Control for Goal-Oriented Humanoid Walking
In this article a predictive task-dependent gaze control strategy for goal-oriented humanoid walking is presented. In the context of active vision systems we introduce an information theoretical approach for maximization of visual information. Based on two novel concepts, Information Content of a view situation and Incertitude, we present a method for selecting optimal subsequent view direction...
متن کاملActive Tactile Exploration Based on Cost-Aware Information Gain Maximization
Active tactile perception is a powerful mechanism to collect contact information by touching an unknown object with a robot finger in order to enable further interaction with the object or grasping of the object. The acquired object knowledge can be used to build object shape models based on such usually sparse tactile contact information. In this paper, we address the problem of object shape r...
متن کاملCoordination for Multi-Robot Exploration and Mapping
This paper addresses the problem of exploration and mapping of an unknown environment by multiple robots. The mapping algorithm is an on-line approach to likelihood maximization that uses hill climbing to find maps that are maximally consistent with sensor data and odometry. The exploration algorithm explicitly coordinates the robots. It tries to maximize overall utility by minimizing the poten...
متن کاملAutonomous Exploration with Expectation-Maximization
We consider the problem of autonomous mobile robot exploration in an unknown environment for the purpose of building an accurate feature-based map efficiently. Most literature on this subject is focused on the combination of a variety of utility functions, such as curbing robot pose uncertainty and the entropy of occupancy grid maps. However, the effect of uncertain poses is typically not well ...
متن کاملComparison of Information Theory Based and Standard Methods for Exploration in Reinforcement Learning
Exploration is a key part of reinforcement learnning. In the classic setting, autonomous agents are supposed to learn a model of their environment to succesfuly complete a task. Recent works in the field and in related fields have suggested the use of quantities based on Shannon’s information theory to enable agents to do so. The underlying concepts of exploration vary between those works. In t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014